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A sieable rcprfeaentative auh^axaple of the standardization group for the Metropolitan 
Achievement Tetfta participated in both the Fall and Spring standardization programs. 
Fall and Spring test records .were matched, for- all such pupils and Fall-Sp/ing 
"growth expectancies'^ were derived. Additionally, thej sample was split into thtee 
subgroups based on pretest national stanine and "growth expectancies" developed ' • 



sedately for below-ayerage, average, and above-average achievers. C^arispn of 
the "growth rates" of these .three groups and of the tptal Fall*Sprlng sample »£th 
•the national norms were made. The resulting data seem most appropriate for test 



users assessing' the short-term growth of non-average groups. 
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Developoent; of ^irical "Growth"; Expeetancies 
for the Ketropolltan Achievement ^Teats ' 



.The relevance of "national nonm" for aasesalng the "j^ovth" jof pupils In academic 
•kilis -** especially ^hose pupils vho are functioning at a below«-average level 
Is questioned by survey achievement test users with Increasing frequency^ This 
paper deals primarily with two distinct Issues relating to the ^elat&g to tha- 
longitudtoal, use of national normative data: ^ 

aO How closely do interpolated achievement test norms' -at>yroxtibate - i 
wxically ''derived norms? That is, can a fall-to-spring ^'growti" 

f . I V 

hd assessed accurately using only* .one set of .emfiirical norms and! 



lother set of Interpolated ^orms? 



Jiven the inapproprlateness :d£V^national averages" fox assessing 
^the-^^'gxowth" bf non-average pupdls (e«gf the foolish expectation 
of "a* month of growth for/a:; month of instruction")., what -a;re«rth 
expectancies can be developed for groups of pupils who are 
achieving at levels significantly above or below the level at! 

\ 

which ^thelr "average" grade-wtes are functioning? These data 
would seem mostr appropriate for. measuring the growth of special 
/ groups such as Title I pupils, puplli^ In communities ^ere ability 
levels are far above (or below) average, etc, 

Until recent years, test publishers provided only'^e set of empirical norms per 
grade for their achievement series; other daita^were dj^rived through interpolation, 
Evefi when a test has been standardized twice or more per grade, not all of the 
score modes (percentiles, grade equivalents, or standard scores) may be based on 



and for the nation as a vhole accbrdlng to 1960 census data/ 



TASVE 1 



• -if SDWMARY OF KEY VARIABLE3 

A?;/? • • USED TO DESCRIBE THE 

plfeOPOLITAN NORM/^fiVE AND FALL-SPRING SAMPLES 



Variable 


Total 
Normative Samolin'fz 


Fall -Soring 
Sample . 


« 

National 
Population 


, ::/ f 

Median Yeaxf 6t Schooling 


10.7 


10.4 


10,6 


Median Family -Income 
(in ^iodU) , ' 


« 

55 


53 


56 


Percent of Black Residents ^ 


9.9 


11.0 


10.5 


Median DeviaTtion 1 Qa 


. 99.5-100.5 


9^.6-lQl.l 


100 

^ — 



The Pall-$Jiing study was conducted by matching by computer and by hand ~ the 
Fall and Spring score reporda of individual pupils. Thus, only pupils ifho took 
both tests; were included in the subsequent analyses, , ^ total of almost 15^000 
cases rang|ng in number by Grade from 1468 in Grade 8 to 2860 in Grade 2 were In- 
cluded in the final satiq)le; 



After matching Fall and Spring pupil records, distributions of ''difference" or "gain 

scores terms of standard scorie^, were run separately by grade and subtest for the 

total sample. Similar distributions were developed for three subgroups of the 

total sample defined in teps of their pretest (Fall) scopes.' Pupils whose Fall 

scores ^fell in stanines l-syompo^sed the first groujp; stanines 4-6 defined the 

average groups; and stanines V-9 defined th^hird group. "Gain" scores by subtjsst 

» 

and grade were distributed and sumoiarized for each of these three groups. Note 



the multiple no^^gs* Additionally, normative samples drawn for multiple normlnga, 

though matched quite closely in relevant characteristics, are bafeed on different 

f » . , 

puplLs* It seems lnq)ortant to assess* Aether these various factors affect the re» 
suits obtained pre- and posttesting identical pupils within the same academic 
year aAd^ interpreting the results in terms of national norms. This study was de- 
signed in part to investigate this question. 

/ 

_ ♦ 

A second purpose of this study was to yield, data descriptive of the "growth" within 
an academic year of three groups of pupils classified according to their pretest 
scores: low achievers (those who scored in national stanii^es f-3 on^heir pretestX, 
average achievers (pretest stanines 4-6), and high achievers (pretest stanlnes 7-9) • 
These data would provide meaningful estimates of the amount. of growth expected of 
pupils wht) fall into one of these groups. .National normative data are most appro* . 

priate for describing the growth of pupils functioning at or near "average," . \ 

» ) 

METHOD 

Twenty of the' school systems in the standardization of the 1970 Metropolitan 
Achievement Tests were involved in both the Fall (Octgber) and Spring (April) 
norming "programs • These twenty systems we;tre selected to be representative of the 
entire standardization group (and thus, of the nations 's school population) in 
terms of relevant population characteristics. Average Otis-Lennon Mental Ability 
Test deviation' IQs for this sanq)le rangeii from a low of 99.6 (Grade 8) Xo 
a high of 101.1 (Grade 5). key variables used in selecting and describing 
the Metropolitan sample included the median years of schooling of adults 
•over age 25 in the community, median family income, and the percent of blacks 
in the population.. Table 1 presents figures fpr th^se variables for -the 
"Fall-Spring" sample, for the total Metropolitan standardization group. 



• ^ thlt ja given pupil^s scoref might have pl^ace4?iiim in i^iffere^^ groups on 1^.ylB^ti0§ 



subtests, . Fox example, *if the pupil Ijad Pall*^ statiine scox^es of 3 in Spelling. and 
4 in Reading, he was plated .Im the below-avei?^e Spelling group and the average 



.Blading groj^. 



RESULTS 



The four score distributions p6r test (total jgroup and the three subgroups) derived 

< 5 ^ ' / ' 

as above yield empirical standard score "growth expectancies'' over, a six-nnonth 

period in Che skills measured by the Metropolitan, Summary growth data and Fall- 
Spring correlations by grade for Metropolitan Total Reading and Total Mathematics 
Ate presented in Tables 2 and 3 for the total sample; tables 4-6 contain data for 
the three Mathematics Tests separately. Additionally, these Hlables present comparable 
data derived froqj the 'total Metropolitan normative sample. 



Tables 7-13pre8|Bnt growth data for seven Metropolitan tests for the three subgroups 
(belowj^verage, average, and above-average) of the sampl^. As would be anticipated, 
the growth of average subgroup is quite comparable to that of the total sample (com- 
pare Tables 2 and 3 with the Average group in Tables 9 and lOO ^ 

7 

In Tables 7-13 no allowances were made for the effects of regression toward the 
mean. This was intentional since most school personnel seldom have either the in- 
cllnation or statistical background for making such adjustments. The data as pre- 
sented are considered generally more appropriate for the typical school User, 



Figures 1 and 2 summarize Tables 2 and 3 in a graphical format. Fall and Spring 
means are plotted and connected by grade on these figures. The solid line indicates 
the Metropolitan normative standard score "growth curve, Aside from Fall-Spring 
vs, normative sample comparison, these figures reveal interesting information re- 
garding the "summer growth/ forget ting" question. 
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Fall, Spring, and "Gains" Sunmary Statistics in Stanaara 
Scores for Pupils Tested in October and April Con^iared 
with MAT "Normative Gains" for the Same Period ~ 


- 




• 


* 






TOTAL READING 


















Fall 


- Spring* Study San^jle 






MAT Nbrms_ 


Grade 


Pall-Spring 
Correlation 


'N 


Fall Scores 
X S.D. 


Spring Scores 
X S..D 


Gain 
Median X S.D. 


• Gain 
Median 




2 


* .76 


2oj1 


45.9 


11.4 


54.8 


10.8 


8.3- 8.9 


7.7 


7.5 


9. ' 


3 


••.77v 


1535 


57.6 


13.3 


62. & 


13.0 


4.6 5.2 


9.0 .' 


4 


4 


4- 


■•..77. 


2180 


66.0 


14.9 


71.7 


14.1 


4.6 5.7 


9.9 


5 


5 


5 


.73 


2361 


74.1 


16.4 


79.6 


13.1 


4.2 ^ 5.4 


11.2 


3.5 


4 


6 


.76 


2404 


81.7 


17.6 


85.5 


14.2 


2.8 3.8 


li.4. 


•» 


s 


7 


.85 


1771 


86.4 


16.6 


89.4 


16.3 


2.6 3.0 


9.1 


1 


2 


8 


.89 


1461 


92.8 


16.6. 


-95.2 


17.4 


2.3 2.5 


8.1 


I 


2 
































TABLE 3 
















Fall,, Spring, and "Gains" Summary Statistics in Standard 
Scores for Pupijs Tested in Octdber and April Compared 
with MAT "Normative Gains" for the Same Period — 








• 






TOTAL MATHEMATICS 












• 


Fall-Spring 
Correlation 




Fail 


- Spring Study Sample 








Grade 


N 


Fall Scores 
"r S.D 


Spring Scores 
X S.D. 


Gain 
Mediai X 


S.D, ■ 


, '""Siln' 
Median 


r 


2 


'75 


^831 


48.6; . 


i2.3- 


.59.6 


ii.2 


10.7 11.0 


8.3 


9 


11 


3 


.74 • 


1611 


62.0 


13.4 


71.4, 


12.2 


9.0 9.3 


9.3 . 


9.5 


8 


4 


.69 


2150 , 


72.8 


14.2 


81.9 ■ 


12.5 


8.2 9.1 


10.7 


8 


7 ■ ' 


5 


.66 


2351 


82.3 


14.7 


88.5. 


11.2 


4.7 6v2 


IL^ 


4 


4 


.6 


.71' 




90.8 


15.5 


96.0 


13.2 


■ 3.8 ■ 5.2 


ILl 


3 


3 


7 


.78 


■ 1760 


96 .-4 


15.8 


100.0 


13,4- 


2.7 3.6 


10.0 


1.5 


2 


8 


• .79 


1461 


102. iZ . 


16.2 


105.6 • 


14.1 


2.6 3.4 


10.0 


1 


1 
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The data presented here' have important advantage's over "growth" charts or tables 
offgre-d in the past^ ' First, the data are empirical — no interpolation or extra- 
polations are involved. Second', and perhaps more importantly, the same pup'ils 



were used for computing the Fall-Spring score changes. The regular Metropolitan 
percentile rank/stanine tables provide the first advantage above. However, the • 
regular "Beginning" and "End" of year norma are not based on identical sets of 
pupils, althcrugh great care was taken to match the two samples as closely as, possi 
ble. An additional advantage of these data is that the sample is closely repre- 
sentative of both the entitt Metropolitan normative sample and'-the nation' a school 
population'^thus making interpretation of ^tained results more meaningful. • 



TABLES 4 



Fall, Spring, and "Gains*' Summary Statistics in Standard 
Scores for Pupils Tested in October and April Compared 
witK MAT "normative -Gains*' for the Same Period — 



Mathematics Computation • 





T 






Fall 


- Spring ^Study Sample 






MAT* Norms 


Srade 


Fall -Spring 
Correlation 


N 


_ ■ Fall 


S .D 


_ Spring 

X S.D. 


Gain _ 
Median X 


S.DT. 


■ Gain 
Median 


X 


3 


.68 ^ 


1632 


58.1, 


11.0 


OO • O 


'in Q 


8.2 


8.5 


8.7 


"B.5 


9 


4 


. .68 


2174 


68.2 


10.9 


78.7 


12.4 


- 10.2 


10.5 


•9.3 


1 n 




5 


.68 

• 


2361 


79.0 


11,1 


86.1 


11.0 


, 6.2 


7.0 


8.8 


5.5 . 


6 


'6 




2393 


88.0 


12.5 


• 94.0 


12.4 


,5.4 . 


6.0 


Q 9 


• 7 ■ 


6 

t 


7 




y776 


94.1 - 


12.7 


9^,8 


. r.'l3.2 


2.5. 


2.8 


8.8 , 


3 


. 2 


8' 


.80 , 


1466 


99.7 


12.9 


103.0 


14.0 


2.7 


3.3 


8.5 ' 


1 - 


1 


• 

Mathematics Concepts 




* 












* 














Fall - 


• Spring Study Sample 






MAT Norms ! 


Grade 


Fall-Spring 
Correlation 


N 


Fall 

X 


S.D. 


Spring 
X S.D.- 


Gain 
Median X 


S.D. 


. • Gain 
Median 


X 


3 


.75 


1622 


59.6 


12.2 


. 67.5 


12.4 


8.1 


7.8 


.8.6 . 


8 


7 


4 


, .74 


2154 


69.2 


12.4 


.76.0 


12.3 


6.4 


6.8 


S.9 


6 


5 


5 * 


.72 


2359 


78.2 


12.5 


83.4 


13.0 


4.7 


5.3 


,9-. 6 


5 


5 ' 


• 6 


.75 V 


2396 


85.2 


13.2 


90.4'' 


14.8 


4.7 . 


5.2 


10.0 


4.5 


•,4 


7 


.77 


1781 


87.7 


12.7 

• 


90.4 


12.7 


2.4 


2.7 


8.6 


0 


1 


8 


.79 


1468 


93.4 


13.7 


96.2 


14.1 


2.3 


2.8 


9.0 


0 


1 



Mathematics Problem Solving ^ 



r- -. _ 








Fall - 


Spring Study Sample 


MAT Norms 


Gra<ie 


Fall-Spring 
Correlation 


N 


/ Fall 
X 


S.D. 


X 


Spring 

S.D. 


Gain 
Median X s:d. 


^Gain 
Median 


X 


. 3 


.71 


1624 


61.3 

t 


13.1 


69.0 


13.6 


7.7 7.8 10.2 


7 ' ' 


7 


4 


.72 


»2167 


71.4 


13.6 


- 78'. 3 


13.6 


6.2 6.9 10.3 


' 6 


6 


5 


.70 


2357 


79.6 


14.3 


.83.8 


"12.8 


3.7 4»'2'l0.6 


, 3.S 


3 


6 


.75 

'a 


2395 


87.6 


15.6 


90.4 


13.8 


2.2 ';2. 8 10.5 


3 


2 


7 


.81 . 


1777 


93.3 


15.7 


97.2 


15.1 


•,-3.7^ 3.9 9.5 


3 


2 


8 


.79 


1466f 


98.4 


16.1 


101.2 


15.1 


2.3 2.8 10.2 


2.5 


1 



c 



10 



TABLES 7 AND 8 



Median, Mean ^nd S.D. of MAT ^Standard Score '^Gains'' Over a Six-Month Period 
by Grade for Three Subgroups and Total 6ro,up (N«1461';2861 per grades) 



WORD KNOWLEDGE 



Qrade 


HIGH PRETEST 
Median Mean 


S.D. 


AVERAGE PRETEST 
Median X S.D. 


LOW PRETEST • 
'Median' X S.D. 


TOTAL GROUP 
Median Mean S.D. 


2 


2,3 


3.8 


813 


9.0 • 


9.4 


5.6 


. 13.0 13.8 


8.5 


8.7 


8.9 


7.9 . 


3 


2.0 


2.0 


.8.9 


5.3 


5.6 


5.4 


5.4 >5 


11.6 


4.8 


4.9 


8.3 


4 


0.4 


2.1 


10.6 


4.5 • 


5.2 


5.9 


5.1 ' 7.9 


13.9 


4.3 


5.1 


9.3-* 


5 


■ 3.7 


4.2 


6.9 


4.0 




6.0 


6i0 9.0 

1 


15.5 


4.3 


5.2' 


9.3 


6 


1.9 


2.]^ 8.0 


3.3 


3.6 


6.0 


4.6 7.4! 


16.(5 


3.1 


4.1 


9.6 


7 


2.5 


2.6 • 


5.8 


2.3 


1.9 


6.-4 


4.4 5.2- 


13.5 • 


2.7 


2.8 


8.4 


8 


1.8 


1.5 . 


7.3 


2.3 


2.1 


7.1 


2.7 , 3.3 


11- 8... 


2.2 


2.2 


8.4 


READING 


















• 

• 






Grade 


H?GH PRETEST 
Median Mean S.D. 


AVERAGE PRETEST 
Median X S.D. 


LOW PRETEST 
Medlatf X S.^. 


TOTAL GROUP 
Mediaii Mean S.D. 


2 


2.8 

« 


3.4 


9.8 


8.0 


7.8 


6.8 


11.3 11.3 


9.9 


7.6 


7.5 


8.6 




5.1 


5.2 


10.1 


4.^9 


5.0 


7.4 


5.3 ^ 7.1 


14.0 


5.0 


5.0 


9V.8 


« 

, 4 


2.3 


2.1 


8.3 


4.5 


'^•5 


7.9 


6.3 —8,5 


15v5 


'4.4. 


4.8. 


10.4 


5 


.3 


.4 


7.1 


3.6, 


3.0 


7.0 


U.7 .14^6 


16.9 


3.5 


A. 6 


11.0- 


6 


-3.8 


-3.4 


8A 


2.6 


2.4 


6.2 


8.3 ll,.-2 


17.5 


2.0 


2.4 


10.9 


7 


1.8 


2.2. 


8.9 




1.2 ■ 


8.2 


5^ 6.3 


r3.4 


2.2 ' 


2.5 


9.9 


8 


.4 


.7 


9.0 ' 


2.3 


2.3 


8.6 


,2.1 2.9 


11.8 


2.0 


2.0 


9.5 






4 








(. 
V 

f ^ 


i 




1 





ERIC 



11 



' 0 " 




f " 




•« — 
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M6ul&n> M6&n find o«U« or hai owanuara 'Dcore uajLuo ,\jycL <x iiuut^u t ex. 
by Grade for Three Subgroups and Total Group (N«1461-2861 iper gr^de) 


* 




TOTAL READING 




* 


















r 




Grade 


HIGH PRETEST 
Median Mean " 


S.D. 


AVERAGE PRETEST 
Median X S.T>. 


, LOW PRETEST 
Indian X S;D.' 


TOTAL GROUP . 
Median Mean S.D. ^ 




- » 


2 


5.9 


6.7 


8.9 


o. z 


Q C 
O. J 


/i 7 


XX .U 


1 9 A 
XZ. 0 


r 

11 1 

iLX . X ^ 




7 7 






3 • 


3.8 


4.2 


8.8 


4.8 


5.1 


4.9. 


1 


6:6 


1^,8. 


4.6 5.2' 


9.0' 






4- 


3.9 


4.0 


7.8 


4.8 


5.3 


5.6 


4r4 


8.7 


18.0 - 


4.6 5.7 


9.9 






5 


, 2.9 


2.0 


5.S 




'X Q 


3.x 




1 n 
X J . u 


91 9 


ii 7 '5 4 


11.2 






6 


.8 


• 9 


7.0 


3.0 


2.8 


4.6 


. 5.2 


10.6 


21.8 


2.8. 3.8 

/ 

2.6 3,.0 
' 2.3 • 2.5 


11.4 






7 • 
8 


3;7 
2.6 


3.9 
2.4 


.6.2 
6.4 


1.7 
2.4 


1.6' 
2.5 


5.8 
6.4 


.3.5 

f 

'1.2 


5.2 

- 1. 
2.4 


15.4, 
12*5 


9.1 
8.1 






TOTAL Mi 


VTHEMATICS 




- 






















Grade 


HIGH PRETEST 
Median Mean 


S.D. 


AVERAGE PRET^SO;^ 
Median X S.D.y 


LOW 
Median 


PRETEST 
' X S.D. 


TOTAL fGROUP 
Median Mean S'.D. > 






2* . 


6.2. 


7.1 . 


8.8 


10.5 


10.8 


6.2 


lo. 1 


16.0 


9^.9 


10.'7(^ 11.0 


8.3 






3 


7.7 


7.0 


6.3 


. 9.4 


9.2 


6.2 


9.7' 


12.7 


15.8 


9.0 ^9.3 


.9.3 . 






4 




6.8 


5.5 


'9.0 


8.8 


5.4 


7.3 


12.4 


20.2 


' 3.2 9.1 


10.7/ 






5. 


4.4 


'4.8 


5.2 


4.4 


4.3 


4.8 


7.2.. 


13.9 


22.2 


•4.7 .6.2. 


11.2 

> 






6 


4.2' 


4.3 


6.1 


3.5 . 


3.8: 


5.1 


4.6- 


10.4 


22.5 


3i8 5.2 
' 2.7 3.6 


11. .1. 






7 


2.8 


' 2.8 


5.1 


2.3 


2.2 


4.9 


3.8 ■ 


7.5 


18.2 


.10.0 






8 


3.3 


3.1 


4^6 


(ST. 

2.0 


f 

2.1 


5.4 


2.9 


6.8. 


18.6 


2.6 3.4 


10.0 
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TAB,LESUl-U' 



Median, Mean and S.p. of MAT Standard Score" "Gains'" Over a Six-Month Period 
■ by Grade,, for Three Subgroups and Total Group, (N-1A61-2861 per' grade) 



MATHEMATICS CCmiTATION. 



f. 



Grade - 


High ■ 
Median X ■ 


SD 


Median -X SD 


1 

Median 


Law- 

X 


SD 


rorst — 

Median X 


SD 


y. 


4.4 


4.4 


8.0 


8.8 


9.0 7.2 


11.4 


12.6 


10 Q 


8.2 


8.5 


ft 7 
0. / 


4 


8.2 


8.1 


.8.2 


11,0 


10.8 8.^ 

• 


10.2 


12.3 


12.5 


10.2 


10.5- 


9:3 


5 . 


5.4 


5.2 . 


6.3 


> 

> 5.9 


6.2* 7.0 


9.5 


11.8 


13.4 


6. -2. 


.7.0 


8;8 


6 


, 3.i 


3.3 


■ 7.2 


6.4 


6.3 , 7.3 


5.8 


8.7 


14 .-1 


5.4 


6.0"^ 


' 9.2 


7 


1.7 


2.5. 


7.2 • 


,2.7 


1.6 7.3 

t 


4.7 


6.4 


12.6- 




• 2.8 » 


8.8 , 


8 


. . 1.1 ■ 


2.7 


8.9 . 


2.8, 

' / 


3.1 - 6.6 


--:5.0 


4. '8' 


11.4 


2.7 


-3.3 


8.5 • 



MATHEMATICS CONCEPTS 



Grade 


High _ 
. Median X 


SD 


' Average 
Median- -X • SD ^ 


Median 


L'ow 

X 


SD* 


Tqi:al_ 
M^dilin X 


SD ' 


3. 

> 


5.6 


5.0 


8.0 


8,3 


8.1 


7.7' 


9.9 


10.6 


10.4 


8.1 


7.8 


8.6 


4 


3.0 


2.9 


6,7 


7.3 


7.2 


6.9 


8.2 - 


9.7 


13.8 


6.4 


•6.a 


S.9 


5., ; 


4.2 


<7 


7.5 


4.2 


4.6 


7.7 


' 7.7 


10.1, 


14.9 


4.7 


5.3" 


9'. 6 


6. 


6.4 


6.2 


.7.8 

• 




3.9 


>.6 


4% • 


7.7 


16.6 


4.7 


5.2. 


10.0 


7 


1.0 


1.1 


8.0 


1.6 


2.0' 


7.1 


5.2 • 


6.0 


11.2 


2.4 


2.7 


8.6 


8 


■ 1:4 


1.6 


8.0 


■2:2 


2,5 


7.7 


3.6 


.5.0 


11.9 


2.3 


2.8 


9.0 



MATHEMATICS PROBLEM S OL VING 



Grade 


High 
Median X 


SD 


Ave^ag 
Median^ X 


e 

SD 


Median 


Low 
X 


SD 


Median 


Total 
X 


SD 


3 


' 4.8 


4.7 


9.2 


7;9 7.5. 


8.6 


10.5 


11.7 


13.2 


7.7 


7.8 


10.2 




- 3.9 


4.1 


7.9 


6.4 "6.8 


^.7 


7.4 


10.0 


15.4 


6.2 . 


6';. 9 


10.3 


5 ' 


. 1.8 


1.2 


7.3- 


*3.6 . 2:.8 

'f 


3.0 


10.3 .. 

r 


12.4 


16.0 


3.7 


4}-2 ' 


10.6 


6 • 


-1..6 


-1.0 


7.J& 




7.2 


6.0 


• 8.7 


16.6 


2.2 


2.8 


10.5 


7 


2.2 


2.5 


7.9 




7.8 


7.8 


8.2 


13.0 


3.7 


3.9 


9.5 


8 


-.3 


.6 


7.6 


2 J 2.0 


8.0 


6.0 


7.5 


15.1 


2.3 


2.8 


* 

10.2 
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